An Open Distributed System for Web Information Indexing and Searching based on Web Views
نویسندگان
چکیده
The task of indexing and searching information in the World-Wide Web face scale problems with Web size and growth. We argue that this is due, in part, to the centralized nature of Web indexing systems currently in use. This paper proposes an open distributed Web View-based system to deal with these problems. The concept of Web View is introduced, the system architecture is presented, and it is shown how the system is able to effectively build, store and search distributed indices. The components of the system modules are then described, and a working prototype is presented.
منابع مشابه
Digital Neighbourhoods: Partitioning the Web for Information Indexing and Searching
General purpose centralized whole Web indexes have become increasingly harder to set up and maintain with the scale problem of Web size. In this article we present a novel approach to information indexing and searching based on partitioning the Web according to Digital Neighbourhoods (DNs). Four concepts of DN are introduced which allow the definition of indexing and searching scopes. The archi...
متن کاملBehavioral Considerations in Developing Web Information Systems: User-centered Design Agenda
The current paper explores designing a web information retrieval system regarding the searching behavior of users in real and everyday life. Designing an information system that is closely linked to human behavior is equally important for providers and the end users. From an Information Science point of view, four approaches in designing information retrieval systems were identified as system-...
متن کاملHF-Blocker: Detection of Distributed Denial of Service Attacks Based On Botnets
Abstract—Today, botnets have become a serious threat to enterprise networks. By creation of network of bots, they launch several attacks, distributed denial of service attacks (DDoS) on networks is a sample of such attacks. Such attacks with the occupation of system resources, have proven to be an effective method of denying network services. Botnets that launch HTTP packet flood attacks agains...
متن کاملUsing Semantic Searching for Web Portals Interoperability
The Web can be viewed as an open heterogeneous information space indexed by search engines and directories based on keywords. The indexing techniques fall short of providing satisfactory efficiency/effectiveness and recall/precision parameters which are required by information search and retrieval systems. The use of metadata for resource discovery would improve these search and retrieval param...
متن کاملIndexing for Vertical Search Engine: Cost Sensitive
The information on the WWW is growing exponentially and the dynamic, unstructured data & structured data needs to locate as useful resources, web pages and online database in enormous quantity. In this paper we propose the novel indexing technique to download the hidden web pages which is based on domain specific. This technique keeps the related documents in the same domain so that searching o...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2007